Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	768
Missing cells	406
Missing cells (%)	5.9%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	54.1 KiB
Average record size in memory	72.2 B

Variable types

Numeric	8
Categorical	1

Alerts

`Outcome` has constant value "0.0"	Constant
`Pregnancies` is highly correlated with `Age`	High correlation
`SkinThickness` is highly correlated with `BMI`	High correlation
`BMI` is highly correlated with `SkinThickness`	High correlation
`Age` is highly correlated with `Pregnancies`	High correlation
`Pregnancies` is highly correlated with `Age`	High correlation
`SkinThickness` is highly correlated with `BMI`	High correlation
`BMI` is highly correlated with `SkinThickness`	High correlation
`Age` is highly correlated with `Pregnancies`	High correlation
`Pregnancies` is highly correlated with `Age`	High correlation
`SkinThickness` is highly correlated with `Insulin` and 1 other fields	High correlation
`Insulin` is highly correlated with `SkinThickness`	High correlation
`BMI` is highly correlated with `SkinThickness`	High correlation
`Age` is highly correlated with `Pregnancies`	High correlation
`Pregnancies` has 23 (3.0%) missing values	Missing
`Glucose` has 16 (2.1%) missing values	Missing
`BloodPressure` has 16 (2.1%) missing values	Missing
`SkinThickness` has 19 (2.5%) missing values	Missing
`Insulin` has 16 (2.1%) missing values	Missing
`BMI` has 16 (2.1%) missing values	Missing
`DiabetesPedigreeFunction` has 16 (2.1%) missing values	Missing
`Age` has 16 (2.1%) missing values	Missing
`Outcome` has 268 (34.9%) missing values	Missing
`Pregnancies` has 111 (14.5%) zeros	Zeros

Reproduction

Analysis started	2022-09-18 11:50:57.772984
Analysis finished	2022-09-18 11:51:14.093898
Duration	16.32 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

Pregnancies
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING
ZEROS

Distinct	12
Distinct (%)	1.6%
Missing	23
Missing (%)	3.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.563758389

Minimum	0
Maximum	11
Zeros	111
Zeros (%)	14.5%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	3
Q3	6
95-th percentile	9
Maximum	11
Range	11
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	3.00296034
Coefficient of variation (CV)	0.8426385887
Kurtosis	-0.5688999247
Mean	3.563758389
Median Absolute Deviation (MAD)	2
Skewness	0.6845704539
Sum	2655
Variance	9.017770802
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
1	135	17.6%
0	111	14.5%
2	103	13.4%
3	75	9.8%
4	68	8.9%
5	57	7.4%
6	50	6.5%
7	45	5.9%
8	38	4.9%
9	28	3.6%
Other values (2)	35	4.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	111	14.5%
1	135	17.6%
2	103	13.4%
3	75	9.8%
4	68	8.9%
5	57	7.4%
6	50	6.5%
7	45	5.9%
8	38	4.9%
9	28	3.6%

Value	Count	Frequency (%)
11	11	1.4%
10	24	3.1%
9	28	3.6%
8	38	4.9%
7	45	5.9%
6	50	6.5%
5	57	7.4%
4	68	8.9%
3	75	9.8%
2	103	13.4%

Glucose
Real number (ℝ_≥0)

MISSING

Distinct	129
Distinct (%)	17.2%
Missing	16
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%
Mean	120.1070115

Minimum	44
Maximum	191
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	44
5-th percentile	80
Q1	99
median	117
Q3	139
95-th percentile	176
Maximum	191
Range	147
Interquartile range (IQR)	40

Descriptive statistics

Standard deviation	28.75511625
Coefficient of variation (CV)	0.2394124696
Kurtosis	-0.3477252184
Mean	120.1070115
Median Absolute Deviation (MAD)	19
Skewness	0.4459438134
Sum	90320.47266
Variance	826.8567103
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	17	2.2%
99	17	2.2%
129	14	1.8%
125	14	1.8%
111	14	1.8%
106	14	1.8%
105	13	1.7%
102	13	1.7%
112	13	1.7%
108	13	1.7%
Other values (119)	610	79.4%
(Missing)	16	2.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
44	1	0.1%
56	1	0.1%
57	2	0.3%
61	1	0.1%
62	1	0.1%
65	1	0.1%
67	1	0.1%
68	3	0.4%
71	4	0.5%
72	1	0.1%

Value	Count	Frequency (%)
191	1	0.1%
190	1	0.1%
189	4	0.5%
188	2	0.3%
187	4	0.5%
186	1	0.1%
184	3	0.4%
183	3	0.4%
182	1	0.1%
181	5	0.7%

BloodPressure
Real number (ℝ_≥0)

MISSING

Distinct	39
Distinct (%)	5.2%
Missing	16
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%
Mean	71.51820666

Minimum	24
Maximum	98
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	24
5-th percentile	52
Q1	64
median	72
Q3	80
95-th percentile	90
Maximum	98
Range	74
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	11.0988587
Coefficient of variation (CV)	0.1551892759
Kurtosis	0.4352308771
Mean	71.51820666
Median Absolute Deviation (MAD)	8
Skewness	-0.2714603482
Sum	53781.69141
Variance	123.1846645
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=39)

Value	Count	Frequency (%)
70	57	7.4%
74	52	6.8%
68	45	5.9%
78	45	5.9%
72	44	5.7%
64	43	5.6%
80	40	5.2%
76	39	5.1%
60	37	4.8%
69.10546875	35	4.6%
Other values (29)	315	41.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
24	1	0.1%
30	2	0.3%
38	1	0.1%
40	1	0.1%
44	4	0.5%
46	2	0.3%
48	5	0.7%
50	13	1.7%
52	11	1.4%
54	11	1.4%

Value	Count	Frequency (%)
98	3	0.4%
96	4	0.5%
95	1	0.1%
94	6	0.8%
92	8	1.0%
90	22	2.9%
88	25	3.3%
86	21	2.7%
85	6	0.8%
84	23	3.0%

SkinThickness
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	41
Distinct (%)	5.5%
Missing	19
Missing (%)	2.5%
Infinite	0
Infinite (%)	0.0%
Mean	25.90624305

Minimum	7
Maximum	47
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	7
5-th percentile	14
Q1	20.53645833
median	22
Q3	32
95-th percentile	42
Maximum	47
Range	40
Interquartile range (IQR)	11.46354167

Descriptive statistics

Standard deviation	8.486654456
Coefficient of variation (CV)	0.3275910923
Kurtosis	-0.452408322
Mean	25.90624305
Median Absolute Deviation (MAD)	5
Skewness	0.5744201519
Sum	19403.77604
Variance	72.02330386
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=41)

Value	Count	Frequency (%)
20.53645833	227	29.6%
32	31	4.0%
30	27	3.5%
27	23	3.0%
23	22	2.9%
28	20	2.6%
18	20	2.6%
33	20	2.6%
31	19	2.5%
39	18	2.3%
Other values (31)	322	41.9%
(Missing)	19	2.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
7	2	0.3%
8	2	0.3%
10	5	0.7%
11	6	0.8%
12	7	0.9%
13	11	1.4%
14	6	0.8%
15	14	1.8%
16	6	0.8%
17	14	1.8%

Value	Count	Frequency (%)
47	4	0.5%
46	8	1.0%
45	6	0.8%
44	5	0.7%
43	6	0.8%
42	11	1.4%
41	15	2.0%
40	16	2.1%
39	18	2.3%
38	7	0.9%

Insulin
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	172
Distinct (%)	22.9%
Missing	16
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%
Mean	109.2513367

Minimum	14
Maximum	465
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	14
5-th percentile	50
Q1	79.79947917
median	79.79947917
Q3	120
95-th percentile	261.15
Maximum	465
Range	451
Interquartile range (IQR)	40.20052083

Descriptive statistics

Standard deviation	66.02068868
Coefficient of variation (CV)	0.6043009694
Kurtosis	5.482330419
Mean	109.2513367
Median Absolute Deviation (MAD)	1
Skewness	2.220288604
Sum	82157.00521
Variance	4358.731334
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
79.79947917	374	48.7%
105	11	1.4%
140	9	1.2%
130	9	1.2%
120	8	1.0%
100	7	0.9%
180	7	0.9%
94	7	0.9%
135	6	0.8%
110	6	0.8%
Other values (162)	308	40.1%
(Missing)	16	2.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
14	1	0.1%
15	1	0.1%
16	1	0.1%
18	2	0.3%
22	1	0.1%
23	2	0.3%
25	1	0.1%
29	1	0.1%
32	1	0.1%
36	3	0.4%

Value	Count	Frequency (%)
465	1	0.1%
440	1	0.1%
415	1	0.1%
402	1	0.1%
392	1	0.1%
387	1	0.1%
375	1	0.1%
370	1	0.1%
360	1	0.1%
342	1	0.1%

BMI
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	234
Distinct (%)	31.1%
Missing	16
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%
Mean	32.02289675

Minimum	18.2
Maximum	46.8
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	18.2
5-th percentile	22.2
Q1	27.475
median	32
Q3	36.1
95-th percentile	43.3
Maximum	46.8
Range	28.6
Interquartile range (IQR)	8.625

Descriptive statistics

Standard deviation	6.240857639
Coefficient of variation (CV)	0.1948873547
Kurtosis	-0.5088654669
Mean	32.02289675
Median Absolute Deviation (MAD)	4.4
Skewness	0.1640359455
Sum	24081.21836
Variance	38.94830408
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
32	13	1.7%
31.6	12	1.6%
31.2	12	1.6%
31.99257812	11	1.4%
33.3	10	1.3%
32.4	10	1.3%
30.1	9	1.2%
32.8	9	1.2%
32.9	9	1.2%
30.8	9	1.2%
Other values (224)	648	84.4%
(Missing)	16	2.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
18.2	3	0.4%
18.4	1	0.1%
19.1	1	0.1%
19.3	1	0.1%
19.4	1	0.1%
19.5	2	0.3%
19.6	3	0.4%
19.9	1	0.1%
20	1	0.1%
20.1	1	0.1%

Value	Count	Frequency (%)
46.8	2	0.3%
46.7	1	0.1%
46.5	1	0.1%
46.3	1	0.1%
46.2	2	0.3%
46.1	2	0.3%
45.8	1	0.1%
45.7	1	0.1%
45.6	2	0.3%
45.5	1	0.1%

DiabetesPedigreeFunction
Real number (ℝ_≥0)

MISSING

Distinct	501
Distinct (%)	66.6%
Missing	16
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%
Mean	0.4444973404

Minimum	0.078
Maximum	1.39
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	0.078
5-th percentile	0.14
Q1	0.23975
median	0.3645
Q3	0.60025
95-th percentile	0.968
Maximum	1.39
Range	1.312
Interquartile range (IQR)	0.3605

Descriptive statistics

Standard deviation	0.2712069586
Coefficient of variation (CV)	0.61014304
Kurtosis	0.6776320936
Mean	0.4444973404
Median Absolute Deviation (MAD)	0.1615
Skewness	1.076351445
Sum	334.262
Variance	0.07355321437
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.258	6	0.8%
0.254	6	0.8%
0.261	5	0.7%
0.268	5	0.7%
0.238	5	0.7%
0.207	5	0.7%
0.259	5	0.7%
0.304	4	0.5%
0.26	4	0.5%
0.245	4	0.5%
Other values (491)	703	91.5%
(Missing)	16	2.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.078	1	0.1%
0.084	1	0.1%
0.085	2	0.3%
0.088	2	0.3%
0.089	1	0.1%
0.092	1	0.1%
0.096	1	0.1%
0.1	1	0.1%
0.101	1	0.1%
0.102	1	0.1%

Value	Count	Frequency (%)
1.39	1	0.1%
1.353	1	0.1%
1.321	1	0.1%
1.318	1	0.1%
1.292	1	0.1%
1.282	1	0.1%
1.268	1	0.1%
1.258	1	0.1%
1.251	1	0.1%
1.224	2	0.3%

Age
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
MISSING

Distinct	44
Distinct (%)	5.9%
Missing	16
Missing (%)	2.1%
Infinite	0
Infinite (%)	0.0%
Mean	32.5

Minimum	21
Maximum	64
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	6.1 KiB

Quantile statistics

Minimum	21
5-th percentile	21
Q1	24
median	29
Q3	40
95-th percentile	54.45
Maximum	64
Range	43
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	10.70286247
Coefficient of variation (CV)	0.3293188451
Kurtosis	0.05671186164
Mean	32.5
Median Absolute Deviation (MAD)	7
Skewness	0.9741945595
Sum	24440
Variance	114.551265
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=44)

Value	Count	Frequency (%)
22	72	9.4%
21	63	8.2%
25	48	6.2%
24	46	6.0%
23	38	4.9%
28	35	4.6%
26	33	4.3%
27	32	4.2%
29	29	3.8%
31	24	3.1%
Other values (34)	332	43.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
21	63	8.2%
22	72	9.4%
23	38	4.9%
24	46	6.0%
25	48	6.2%
26	33	4.3%
27	32	4.2%
28	35	4.6%
29	29	3.8%
30	21	2.7%

Value	Count	Frequency (%)
64	1	0.1%
63	4	0.5%
62	4	0.5%
61	2	0.3%
60	5	0.7%
59	3	0.4%
58	7	0.9%
57	5	0.7%
56	3	0.4%
55	4	0.5%

Outcome
Categorical

CONSTANT
MISSING
REJECTED

Distinct	1
Distinct (%)	0.2%
Missing	268
Missing (%)	34.9%
Memory size	6.1 KiB

0.0	500

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	1500
Distinct characters	2
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0.0
2nd row	0.0
3rd row	0.0
4th row	0.0
5th row	0.0

Common Values

Value	Count	Frequency (%)
0.0	500	65.1%
(Missing)	268	34.9%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0.0	500	100.0%

Most occurring characters

Value	Count	Frequency (%)
0	1000	66.7%
.	500	33.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	1000	66.7%
Other Punctuation	500	33.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	1000	100.0%

Other Punctuation

Value	Count	Frequency (%)
.	500	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	1500	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	1000	66.7%
.	500	33.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	1500	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	1000	66.7%
.	500	33.3%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome
0	6.0	148.0	72.000000	35.000000	79.799479	33.600000	0.627	50.0	NaN
1	1.0	85.0	66.000000	29.000000	79.799479	26.600000	0.351	31.0	0.0
2	8.0	183.0	64.000000	20.536458	79.799479	23.300000	0.672	32.0	NaN
3	1.0	89.0	66.000000	23.000000	94.000000	28.100000	0.167	21.0	0.0
4	0.0	137.0	40.000000	35.000000	168.000000	43.100000	NaN	33.0	NaN
5	5.0	116.0	74.000000	20.536458	79.799479	25.600000	0.201	30.0	0.0
6	3.0	78.0	50.000000	32.000000	88.000000	31.000000	0.248	26.0	NaN
7	10.0	115.0	69.105469	20.536458	79.799479	35.300000	0.134	29.0	0.0
8	2.0	NaN	70.000000	45.000000	NaN	30.500000	0.158	53.0	NaN
9	8.0	125.0	96.000000	20.536458	79.799479	31.992578	0.232	54.0	NaN

Last rows

	Pregnancies	Glucose	BloodPressure	SkinThickness	Insulin	BMI	DiabetesPedigreeFunction	Age	Outcome
758	1.0	106.0	76.0	20.536458	79.799479	37.5	0.197	26.0	0.0
759	6.0	190.0	92.0	20.536458	79.799479	35.5	0.278	NaN	NaN
760	2.0	88.0	58.0	26.000000	16.000000	28.4	0.766	22.0	0.0
761	9.0	170.0	74.0	31.000000	79.799479	44.0	0.403	43.0	NaN
762	9.0	89.0	62.0	20.536458	79.799479	22.5	0.142	33.0	0.0
763	10.0	101.0	76.0	NaN	180.000000	32.9	0.171	63.0	0.0
764	2.0	122.0	70.0	27.000000	79.799479	36.8	0.340	27.0	0.0
765	5.0	121.0	72.0	23.000000	112.000000	26.2	0.245	30.0	0.0
766	1.0	126.0	60.0	20.536458	79.799479	30.1	0.349	47.0	NaN
767	1.0	93.0	70.0	31.000000	79.799479	30.4	0.315	23.0	0.0

Overview

Variables

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Other Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows